Data61-CSIRO systems at the CLPsych 2016 Shared Task
نویسندگان
چکیده
This paper describes the Data61-CSIRO text classification systems submitted as part of the CLPsych 2016 shared task. The aim of the shared task is to develop automated systems that can help mental health professionals with the process of triaging posts with ideations of depression and/or self-harm. We structured our participation in the CLPsych 2016 shared task in order to focus on different facets of modelling online forum discussions: (i) vector space representations; (ii) different text granularities; and (iii) fineversus coarse-grained labels indicating concern. We achieved an F1score of 0.42 using an ensemble classification approach that predicts fine-grained labels of concern. This was the best score obtained by any submitted system in the 2016 shared task.
منابع مشابه
CSIRO Data61 at the WNUT Geo Shared Task
In this paper, we describe CSIRO Data61’s participation in the Geolocation shared task at the Workshop for Noisy User-generated Text. Our approach was to use ensemble methods to capitalise on four component methods: heuristics based on metadata, a label propagation method, timezone text classifiers, and an information retrieval approach. The ensembles we explored focused on examining the role o...
متن کاملMental Distress Detection and Triage in Forum Posts: The LT3 CLPsych 2016 Shared Task System
This paper describes the contribution of LT3 for the CLPsych 2016 Shared Task on automatic triage of mental health forum posts. Our systems use multiclass Support Vector Machines (SVM), cascaded binary SVMs and ensembles with a rich feature set. The best systems obtain macro-averaged F-scores of 40% on the full task and 80% on the green versus alarming distinction. Multiclass SVMs with all feat...
متن کاملUsing Linear Classifiers for the Automatic Triage of Posts in the 2016 CLPsych Shared Task
The 2016 CLPsych Shared Task was to automatically triage posts from a mental health forum into four categories: green (everything is fine), amber (a moderator needs to look at this post), red (a moderator urgently needs to look at this post) and crisis (the person might hurt himself or others). The final results for the task revealed that this problem was not an easy task. I chose to treat the ...
متن کاملThe UMD CLPsych 2016 Shared Task System: Text Representation for Predicting Triage of Forum Posts about Mental Health
We report on a multiclass classifier for triage of mental health forum posts as part of the CLPsych 2016 shared task. We investigate a number of document representations, including topic models and representation learning to represent posts in semantic space, including contextand emotion-sensitive feature representations of posts.
متن کاملSemi-supervised CLPsych 2016 Shared Task System Submission
The 2016 CLPsych Shared Task is centered on the automatic triage of posts from a mental health forum, au.reachout.com. In this paper, we describe our method for this shared task. We used four different groups of features. These features are designed to capture stylistic and word patterns, together with psychological insights based on the Linguistic Inquiry and Word Count (LIWC) word list. We us...
متن کامل